Web Survey Bibliography
Title Gamifying Questions Using Text Alone
Author Cape, P. J.
Year 2016
Access date 29.04.2016
Presentation PPT (4.64MB)
Abstract
Relevance & Research Question: Most practitioners will be aware of the concept of gamification. Fewer however will be aware of how gamification can be achieved in practice and most, we suspect, will be overwhelmed at the prospect of designing a ‘game’. In this presentation we propose a framework for understanding gamification, without the need for games. We define the key features of a game and link this to established theories of motivation and questioning practices emanating from behavioural economics. In experiment we ask the question – can simple text based gamification techniques give us richer and deeper data than our traditional questioning style?
Methods & Data: The results of two experiments will be presented. In both instances online interviewing was employed. The first experiment looks at a question of spontaneous brand awareness within the Mobile Phone category. 150 interviews per test (gamified) and control (standard) cell were undertaken. In this test we introduce a game mechanic, the question itself is unchanged. Data to be presented will be the number of brands mentioned and what those brands are. In the second experiment we conducted surveys in two countries with 600 and 300 interviews per country per cell (gamified vs non-gamified). In this experiment game consisted of adding a hypothetical scenario to and open question – getting the respondent to imagine they were speaking to the CEO. A rule that a maximum of only 3 things could be said to the CEO was added.
Results: In the first experiment the number of brands mentioned on average increased from 4 to 6. These brands were not obscure “extra” brands, but more mentions of the best known brands. This implies that our standard online questioning techniques encourage satisficing behaviour. The second experiment resulted in more content (measured by number of characters typed) and more codable content being given. The number of people giving 3 codable answers increased from 5% to 47%.
Added Value: In addition to proving again that gamification ‘works’ to increase data this paper also shows how simple it is to execute a gamified question using text alone.
Methods & Data: The results of two experiments will be presented. In both instances online interviewing was employed. The first experiment looks at a question of spontaneous brand awareness within the Mobile Phone category. 150 interviews per test (gamified) and control (standard) cell were undertaken. In this test we introduce a game mechanic, the question itself is unchanged. Data to be presented will be the number of brands mentioned and what those brands are. In the second experiment we conducted surveys in two countries with 600 and 300 interviews per country per cell (gamified vs non-gamified). In this experiment game consisted of adding a hypothetical scenario to and open question – getting the respondent to imagine they were speaking to the CEO. A rule that a maximum of only 3 things could be said to the CEO was added.
Results: In the first experiment the number of brands mentioned on average increased from 4 to 6. These brands were not obscure “extra” brands, but more mentions of the best known brands. This implies that our standard online questioning techniques encourage satisficing behaviour. The second experiment resulted in more content (measured by number of characters typed) and more codable content being given. The number of people giving 3 codable answers increased from 5% to 47%.
Added Value: In addition to proving again that gamification ‘works’ to increase data this paper also shows how simple it is to execute a gamified question using text alone.
Access/Direct link Conference Homepage (presentation)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - 2016 (264)
- Privacy Concerns in Responses to Sensitive Questions. A Survey Experiment on the Influence of Numeric...; 2016; Bader, F., Bauer, J., Kroher, M., Riordan, P.
- Ballpoint Pens as Incentives with Mail Questionnaires – Results of a Survey Experiment; 2016; Heise, M.
- Non-Observation Bias in an Address-Register-Based CATI/CAPI Mixed Mode Survey; 2016; Lipps, O.
- Spatial Modeling through GIS to Reveal Error Potent ial in Survey Data: Where, What and How Much ; 2016; English, N.; Ventura, I.; Bilgen, I.; Stern, M. J.
- Bees to Honey or Flies to Manure? How the Usual Subject Recruitment Exacerbates the Shortcomings of...; 2016; Snell, S. A., Hillygus, D. S.
- Thinking Inside the Box Visual Design of the Response Box Affects Creative Divergent Thinking in an...; 2016; Mohr, A. H.; Sell, A.; Lindsay, T.
- Detecting careless respondents in web-based questionnaires: Which method to use?; 2016; Niesen, A. S. M.; Meijer, R. R.; Tendeiro, J. N.
- Web surveys for offline rural communities ; 2016; Gichohi, B. W.
- On-line life history calendar and sensitive topics: A pilot study; 2016; Morselli, D.; Berchtold, A.; Granell, J.-C. S.; Berchtold, And.
- Does survey mode matter for studying electoral behaviour? Evidence from the 2009 German Longitudinal...; 2016; Bytzek, E.; Bieber, I. E.
- The impact of visual design and response formats on data quality in a web survey of MOOC students; 2016; Maloshonok, N.; Terentev, E.
- An experiment comparing grids and item-by-item formats in web surveys completed through PCs and smartphones...; 2016; Revilla, M.; Toninelli, D.; Ochoa, C.
- Establishing the accuracy of online panels for survey research; 2016; Bruggen, E.; van den Brakel, J.; Krosnick, J. A.
- Gamifying Questions Using Text Alone; 2016; Cape, P. J.
- Assessing the Effects of Participant Preference and Demographics in the Usage of Web-based Survey Questionnaires...; 2016; Mlikotic, R.; Parker, B.; Rajapakshe, R.
- Improving Inpatient Surveys: Web-Based Computer Adaptive Testing Accessed via Mobile Phone QR Codes; 2016; Chien, T. S.; Lin, W.S.
- Surveying End-of-Life Medical Decisions in France: Evaluation of an Innovative Mixed-Mode Data Collection...; 2016; Legleye, S; Pennec, S.; Monnier, A.; Stephan, A.; Brouard, N.; Bilsen, J.; Cohen, J.
- Problems and Prospects in Survey Research; 2016; Moy, P.; Murphy, J.
- Eye-tracking Social Desirability Bias; 2016; Kaminska, O.; Foulsham, T.
- Pre-Survey Text Messages (SMS) Improve Participation Rate in an Australian Mobile Telephone Survey:...; 2016; Dal Grande, E.; Chittleborough, C. R.; Campostrini, S.; Dollard, M.; Taylor, A. W.
- Pitfalls, Potentials, and Ethics of Online Survey Research: LGBTQ and Other Marginalized and Hard-to...; 2016; McInroy, L. B.
- Effects of Personalization and Invitation Email Length on Web-Based Survey Response Rates; 2016; Trespalacios, J. H.; Perkins, R. A.
- Forecasting proportional representation elections from non-representative expectation surveys; 2016; Graefe, A.
- Short and Sweet? Length and Informative Content of Open-Ended Responses Using SMS as a Research Mode; 2016; Walsh, E.; Brinker, J. K.
- Mixing modes of data collection in Swiss social surveys: Methodological report of the LIVES-FORS mixed...; 2016; Roberts, C.; Joye, D.; Staehli, M. E.
- Comparing online and telephone survey results in the context of a skin cancer prevention campaign evaluation...; 2016; Hollier, L.P.; Pettigrew, S.; Slevin, T.; Strickland, M.; Minto, C.
- Options for Fielding and Analyzing Web Surveys; 2016; Schonlau, M.; Couper, M. P.
- Report of the Inquiry into the 2015 British general election opinion polls; 2016; Sturgis, P., Baker, N., Callegaro, M., Fisher, St., Green, J., Jennings, W., Kuha, J., Lauderdale, B...
- Sample Representation and Substantive Outcomes Using Web With and Without Incentives Compared to Telephone...; 2016; Lipps, O.; Pekari, N.
- Effects of Data Collection Mode and Response Entry Device on Survey Response Quality; 2016; Ha, L.; Zhang, Che.; Jiang, W.
- The Dynamic Identity Fusion Index: A New Continuous Measure of Identity Fusion for Web-Based Questionnaires...; 2016; Jimenez, J.; Gomez, A.; Buhrmester, M.; Whitehouse, H.; Swann, W. B.
- Navigation Buttons in Web-Based Surveys: Respondents’ Preferences Revisited in the Laboratory; 2016; Romano Bergstrom, J. C.; Erdman, C.; Lakhe, S.
- Collecting Data from mHealth Users via SMS Surveys: A Case Study in Kenya; 2016; Johnson, D.
- “Money Will Solve the Problem”: Testing the Effectiveness of Conditional Incentives for...; 2016; DeCamp, W.; Manierre, M. J.
- Effects of Incentive Amount and Type of Web Survey Response Rates; 2016; Coopersmith, J.; Vogel, L. K.; Bruursema, T.; Feeney, K.
- Effect of a Post-paid Incentive on Response to a Web-based Survey; 2016; Brown, J. A.; Serrato, C. A.; Hugh, M.; Kanter, M. H.; A.; Spritzer, K. L.; Hays, R. D.
- Dropouts in Longitudinal Surveys; 2016; Lugtig, P. J.; De Leeuw, E. D.
- Participant recruitment and data collection through Facebook: the role of personality factors; 2016; Rife, S. C.; Cate, K. L.; Kosinski, M.; Stillwell, D.
- Evaluating a New Proposal for Detecting Data Falsification in Surveys; 2016; Simmons, K.; Mercer, A. W.; Schwarzer, S.; Courtney, K.
- Quantifying Under- and Overreporting in Surveys Through a Dual-Questioning-Technique Design. ; 2016; de Jong , M.; Fox, J.-P.; Steenkamp, J. - B. E. M.
- Take the money and run? Redemption of a gift card incentive in a clinician survey. ; 2016; Chen, J. S.; Sprague, B. L.; Klabunde, C. N.; Tosteson, A. N. A.; Bitton, A.; Onega, T.; MacLean, C....
- Solving the Nonresponse Problem With Sample Matching?; 2016
- Do Polls Still Work If People Don't Answer Their Phones?; 2016; Edwards-Levy, A.; Jackson, N. M.
- A Framework of Incorporating Thai Social Networking Data in Online Marketing Survey; 2016; Jiamthapthaksin, R.; Aung, T. H.; Ratanasawadwat, N.
- Development of a scale to measure skepticism toward electronic word-of-mouth; 2016; Zhang, Xia.; Ko, M.; Carpenter, D.
- Improving social media measurement in surveys: Avoiding acquiescence bias in Facebook research; 2016; Kuru, O.; Pasek, J.
- Psychological research in the internet age: The quality of web-based data; 2016; Ramsey, S. R.; Thompson, K. L.; McKenzie, M.; Rosenbaum, A.
- Internet Abusive Use Questionnaire: Psychometric properties; 2016; Calvo-Frances, F.
- The impact of academic sponsorship on Web survey dropout and item non-response; 2016; Allen, P. J.; Roberts, L. D.
- Measuring Generalized Trust: An Examination of Question Wording and the Number of Scale Points; 2016; Lundmark, S.; Giljam, M.; Dahlberg, S.